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Abstract 


The main purpose of this paper is to investigate the strong approximation of the integrated empirical process. 

More precisely, we obtain the exact rate of the approximations by a sequence of weighted Brownian bridges 
and a weighted Kiefer process. Our arguments are based in part on the Komlos et al. (1975)’s results. Appli¬ 
cations include the two-sample testing procedures together with the change-point problems. We also consider 
the strong approximation of the integrated empirical process when the parameters are estimated. Finally, we 
study the behavior of the self-intersection local time of the partial sum process representation of the integrated 
empirical process. 
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1 Introduction 

Let {Xi : i E N*} be a sequence of independent, identically distributed [i.i.d.] random variables [r.v.’s] with 
continuous distribution function [d.f.] F{t) = P{Ai < f} for f E M. For each n E N*, let ]F„ be the empirical 
d.f. based upon the sample Xi,..., Xn defined as 



for f E M, 


( 1 . 1 ) 


where ^ denotes cardinality. For each n E N* , we introduce the empirical process an defined by 

Oin{t)'■= VniVn{t) — F{t)) for t E M. 


(1.2) 


We denote by Q{y) := inf{x E M : F{x) > y} for y E (0,1) the usual quantile function (generalized inverse) 
pertaining to F, and extend its definition to [0,1] by setting 


<5(0) := limQ(y) and Q(l) := limQ(?/). 
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Consider additionally a sequence of i.i.d. r.v.’s {Ui : i G N*} uniformly distributed on [0, 1] such that Xi = 
Q{Ui) (cf. Shorack and Wellner (1986), p. 3 and the references therein). For each n G N*, let be the 
empirical d.f. based upon the sample C/i, ..., Un'- 

1 1 ” 

Un(u) := -#{i G {1,. .. ,n} : C/i < u} =-^ for uGfO, 1]. 

i=l 

We introduce the corresponding uniform empirical process j3n defined, for each n G N*, by 

j3n{u)'■= s/nifJniu) — u) for rtG[0,l]. (1.3) 

We have the usual relation between the empirical process and uniform empirical process: 

an{t) = ^n{F{t)) for tGM, nGN*. 


In this paper, we consider the integrated empirical d.f. based upon the sample Xi,, X^ 

rt 


F, 


i{t) := f F„(s)dF„(s) for f G M, n G N* 

J —OO 


together with the corresponding integrated empirical process 

:= s/n (F„(f) — F{t)') for t G M, n G N* 


(1.4) 


(1.5) 


where 

F{t)-.= f F{s)dF{s) = lFitf. 

J —OO ^ 


From Theorem II. 1 of Henze and Nikitin (2002) (see also the self-contained proof given in Section 7), we learn 
that, almost surely. 


Fn(f) 


1 

2 


Fn(f)^ + -F„(f) 
n 


for f G M, n G N*. 


(1.6) 


Henze and Nikitin (2000, 2002) introduced and deeply investigated the goodness-of-fit testing procedures 
based on the integrated empirical process. Indeed, the asymptotic properties of their procedures, Kolmogorov- 
Smirnov, Cramer-von Mises and Watson-type statistics, can be derived from the limiting behavior of the in¬ 
tegrated empirical process. Henze and Nikitin (2003) considered a two-sample testing procedure and focused 
on the approximate local Bahadur efficiencies of their statistical tests. It is noteworthy to point out that tests 
based on some integrated empirical processes turn out to be more efficient for certain distributions. In Lachal 
(2001), another version of the integrated empirical process (actually a broader class of p-fold integrated em¬ 
pirical process, p G N*) was introduced. For the extension to the multivariate framework, we may refer to 
ling and Wang (2006) and ling and Yang (2007) where some projected integrated empirical processes for testing 
the equality of two multivariate distributions are considered. Inspired by the work of Henze and Nikitin (2003), 
Bouzebda and ElFaouzi (2012) developed multivariate two-sample testing procedures based on the integrated 
empirical copula process that are extended to the iF-sample problem in Bouzebda ct aZ. (2011). Emphasis is 
placed on the explanation of the strong approximation methodology. The asymptotic behavior of weighted mul¬ 
tivariate Cramer-von Mises-type statistics under contiguous alternatives was characterized by Bouzebda and Zari 
(2013). 

The main purpose of this paper is to investigate the strong approximation of the integrated empirical process. 
Next we study the asymptotic properties of statistical tests based on this process. We also study the behavior 
of the self-intersection local time of the partial sum process representation of the integrated uniform empirical 
process. To our best knowledge, the problem that we consider was open up to presently, and it gives the main 
motivation to our study. 
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Let us point out that the strong approximations are quite useful and have received considerable attention in 
probability theory. Indeed, many well-known and important probability theorems can be considered as conse¬ 
quences of results about strong approximation of sequences of sums by corresponding Gaussian sequences. 

We will first obtain an upper bound in probability for the distance between the integrated empirical process 
and a sequence of appropriate Brownian bridges (see Theorem 2.2). This is the key point of our study. From 
this, we will deduce a strong approximation of the integrated empirical process by this sequence of Brownian 
bridges (see Corollary 2.4). As an application, we will derive the rates of convergence for the distribution of 
smooth functionals of the integrated empirical process (see Corollary 2.3). Moreover, we will deduce strong ap¬ 
proximations for the Kolmogorov-Smirnov and Cramer-von Mises-type statistics associated with the integrated 
empirical process (see Corollary 2.7). 

Second, we will obtain a strong approximation of the integrated empirical process by a Kiefer processes (see 
Theorem 2.5). This latter is of particular interest; indeed, for instance, any kind of law of the iterated logarithm 
which holds for the partial sums of Gaussian processes may then be transferred to the integrated empirical process 
(see Corollary 2.6). We may refer to DasGupta (2008) (Chapter 12), Csdrgo and Horvath (1993) (Chapter 3), 
Csdrgo and Revesz (1981) (Chapters 4-5) and Shorack and Wellner (1986) (Chapter 12) for expositions, details 
and references about this problem. 

We refer to Csdrgo and Hall (1984), Csdrgo (2007) and Mason and Zhou (2012) for a survey of some appli¬ 
cations of the strong approximation and many references. There is a huge literature on the strong approximations 
and their applications. It is not the purpose of this paper to survey this extensive literature. 

The layout of the article is as follows. In Section 2, we first present some strong approximation results for the 
integrated empirical process; our main tools are the results of Komlds et al. (1975). Sections 3 and 4 are devoted 
to statistical applications, namely the two-sample and change-point problems respectively. In Section 5, we deal 
with the strong approximation of the integrated empirical process when parameters are estimated. Section 6 
is concerned with the behavior of the self-intersection local time of the partial sum process representation of 
the integrated empirical process. To prevent from interrupting the flow of the presentation, all mathematical 
developments are postponed to Section 7. 

2 Strong approximation 

First, we introduce some definitions and notations. Let W = {W(s) : s > 0} and B = {B(tt) : rt € [0,1]} 
be the standard Wiener process and Brownian bridge, that is, the centered Gaussian processes with continuous 
sample paths, and covariance functions 

E(W(s)W(f)) = s A f for s,f>0 

and 

E(B(ri)B(u)) = u A u — ttu for tt,u€[0,1]. 

A Kiefer process IK = {IK(s,ri) : s > 0,ri € [0,1]} is a two-parameters centered Gaussian process, with 
continuous sample paths, and covariance function 

lK(K{s,u)K{t,v)) = {s At) {u Av — uv) for s,t>0 and tt,u€[0,1]. 

It satisfies the following distributional identities: 

{K(s, u) : u G [0,1]} = {■v/sB(m) : u G [0,1]} for s>0 

and 

{]K(s,u) : s > 0} = I u{l — rt) W(s) : s > o| for uG[0, 1], 

£ 

where = stands for the equality in distribution. The interested reader may refer to Csdrgo and Revesz (1981) 
for details on the Gaussian processes mentioned above. It is well-known that the empirical uniform process 
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{j5n '■ n G N*} converges to B in D[0,1] (the space of all right-continuous real-valued functions defined on [0,1] 
which have left-hand limits, equipped with the Skorohod topology; see, for details, Billingsley (1968)). The 
rate of convergence of this process to B is an important task in statistics as well as in probability that has been 
investigated by several authors. We can and will assume without loss of generality that all r.v.’s and processes 
introduced so far and later on in this paper can be defined on the same probability space (cf. Appendix 2 in 
Csdrgo and Horvath (1993)). Komlos, Major, and Tusnady [KMT] (Komlos et al. (1975), Theorem 3; refer also 
to Komlos et al. (1976)) stated the following Brownian bridge approximation for {fin '■ n G N*}, along with a 
description of its proof with few details. 

Theorem A On a suitable probability space, we can define the uniform empirical process {fin '■ n G N*}, in 
combination with a sequence of Brownian bridges {B„ : n G N*}, such that, for all x > 0 and all n G N*, 

p| sup \fin{u)-Mn{u)\> ^{ci\ogn + x)\ < C 2 e~'^^'^, ( 2 . 1 ) 

I ne[o,i] V ^ J 

where ci, C 2 and C 3 are positive universal constants. 

In his manuscript. Major (2000) details the original proof of (2.1). Chatterjee (2012) provided a new alternative 
approach for proving the famous KMT theorem. 

Remark 2.1 In the sequel, the precise meaning of “suitable probability space” is that an independent sequence 
of Wiener processes, which is independent of the originally given sequence ofi.i.d. r.v.’s, can be constructed on 
the assumed probability space. This is a technical requirement which allows the construction of the Gaussian 
processes displayed in our theorems, and which is not restrictive since one can expand the probability space to 
make it rich enough (see, e.g.. Appendix 2 in Csdrgo and Horvath ( 1993 ), de Acosta (1982 ), Csdrgo and Revesz 
(1981 ) and Lemma Al in Berkes and Philipp (1979)). Throughout this paper, it will be assumed that the under¬ 
lying probability spaces are suitable in this sense. 

In the following theorem, we state the key point to access the strong approximation of the integrated empirical 
process {an-,n G N*}. 

Theorem 2.2 On a suitable probability space, we may define the integrated empirical process {a„ : n G N*}, in 
combination with a sequence of Brownian bridges {B„ : n G N* }, such that, for large enough x and all n G N*, 

pjsup \a.n{t) - F{t)Mn{F{t))\ > (Alogn + x) 1 < B (2.2) 

I isR ' s/n J 

where A, B and C are positive universal constants. 

An important consequence of Theorem 2.2 is an upper bound for the convergence of distributions of smooth 
functionals of Indeed, applying (2.2) with x = c log n for a suitable constant c yields the result below. 

Corollary 2.3 If is a Lipschitz functional defined on D[0, -|-oo) such that the r.v. ^(F(-) M(F(-))) admits 
a bounded density function, then, as n ^ 00 , 

sup|P{$(a„(-)) <x} -P{$(F(-)B(F(-))) <x}| (2.3) 

xeR V / 

For more comments on this kind of results, we may refer to Csdrgo et al. (2000), Corollary 1.1 and p. 2459. 

By applying (2.2) to x = c' log n for a suitable constant d and appealing to Borel-Cantelli lemma, one can 
obtain the following almost sure approximation of the process {an : n G N*} based on a sequence of Brownian 
bridges. 


4 



Corollary 2.4 The following bound holds, with probability 1, as n —)• oo; 


sup \an{t) - F{t)Mn{F{t))\ =0 
teM 



(2.4) 


The next result yields an almost sure approximation for {a„ : n G N*} based on a Kiefer process. 

Theorem 2.5 On a suitable probability space, we may define the integrated empirical process {oin : n G N*}, 
in combination with a Kiefer process {]K(s, u) : s > 0, u G [0,1]}, such that, with probability \, as n ^ oo. 


max sup 

l<fc<n igK 


Vkakf) - F(t)K(k,F(t)) 


0((lognf). 


From Theorem 2.5 and by invoking the law of the iterated logarithm for Gaussian sequences, we have almost 
surely 


SUPjgK |«n(f)| SUP 4 g]R|F(f)]K(n,F(f))| 

lim sup- — = lim sup- =- 

n^oo V log log n n^oo v^loglogn 

= sup ^2 Var(F(f) ]K(1, F{t))) = sup \/2 Var(u]K(l, u)). (2.5) 

Observing that Var(u]K(l, tt)) = tt^(l — u) and sup„g[o,i] — u) = TJ (2.5) readily implies the 
following corollary (“a.s.” stands for “almost surely”). 


Corollary 2.6 We have the following law of iterated logarithm for the integrated empirical process: 

SUPtgR |«n(f)| _ 3^3 


lim sup 


a.s. 


\/Iogk)g7i 8^2 

As a direct application of (2.4) and (2.6) to the problem of goodness-of-fit, for testing the null hypothesis 


( 2 . 6 ) 


no:F = Fo, 


we can use the following statistics: the integrated Kolmogorov-Smirnov statistic as well as the integrated Cramer- 
von Mises statistic 

:= sup |v^(F„(f) - Fo(f))| and := n / (F„(f) - Fo(f))^ dFo(f). 

teR Jr 


Corollary 2.7 We have, under TLo, with probability 1, as n ^ oo. 


S„ - sup |F(f)B„(F(f))| 

tm \ Vn J 

[ [F{t)M^{F{t))]^ dFoit) 

Jr 


log log n 


n 


logn 


(2.7) 

( 2 . 8 ) 
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3 The two-sample problem 


For each m,n ^ N*, let Xi,..., Xm and Yi,..., be independent random samples from continuous d.f.’s 
F and G, respectively, and let and denote their respective integrated empirical d.f.’s. Tests for the null 
hypothesis 

n'o-F = G, 

can be based on the integrated two-sample empirical process defined, for each m, n G N*, by 


for 

’ V rn + n 

We can use the following statistics for testing T-Lq'. the integrated two-sample Kolmogorov-Smirnov statistic as 
well as the integrated two-sample Cramer-von Mises statistic 


im,n ■= sup 1^^ 
teM 


iit)\ and 


- m,n 




Set, for any m,n gW, 


(p{m, n) 


max 




and (f){m,n) := max 


I log log m 


m 


log m, 


log log n 


n 


log n 


The following results are consequences of Corollary 2.4. 

Corollary 3.1 On a suitable probability space, it is possible to define ■ rn, n G N*}, jointly with a 

sequence of Gaussian processes ■. m,n G N*}, such that, under T-Lq, with probability 1, as min(m,n) ^ 

oo, 

Srip|lm,n(f) -®m,n(f)| =0{p{m,n)), 
tGM. 

where 

= Fit) ( l^—MUFit)) - J-^MliFit))] , 

’ \\j n -\- m \ n m J 

the processes {Bm : m G N*} and {B^ : n G N*} consisting of two sequences of Brownian bridges constructed 
as in Theorem 2.2. 


Corollary 3.2 We have, under TL'q, with probability 1, as min(m, n) oo. 


Sm,n -SUp|B;;^,,(f)| 
tGM. 


= Oiip{m,n)) and 


T — 

m,n 


[ M*^^^it)^dFit) 

Jr 


= Oifim, n)). 


As in Bouzebda and El Faouzi (2012), consider the following modified integrated two-sample empirical pro¬ 
cess, for a fixed positive infeger q, 


^Sn(f):=t/^^(lFm(f)''-G„(f)'') for t G M. 
’ \j m + n ^ ' 


Reasonable sfafislics for fesfing TL'q would be fhe modified integrated Kolmogorov-Smirnov statistic and fhe 
modified integrated Cramer-von Mises statistic 


0 ( 9 ) 

^m,n 


sup 

tGR 



and T^n 


[ ^i,iit)^dFit). 

Jr 


We exfend Corollary 3.1 and 3.2 as follows. 
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Corollary 3.3 On a suitable probability space, it is possible to define € N*}, jointly with a 

sequence of Gaussian processes : m,n G N*}, such that, under T-Lq, with probability 1, as min(m,n) ^ 

oo, 

=OMm,n)), 


sup 

teM 


where 


’ \\j m + n \j m + n 


Corollary 3.4 Under TL'q, with probability 1, as min(m, n) ^ oo, we have 


s;^;„-sup|B;(^)(i)i 


teM 


= 0(p(m,n)) and 


Tfiq) 

m,n 


^m.n 


{tfdF{t) 


= 0{(f>{m, n)). 


Remark 3.5 The family of statistics indexed by q may be used to maximize the power of the statistical test for a 
specific alternative hypothesis as argued in Ahmad and Dorea (2001 ). 


Now, we fix a positive integer K and we describe the more general K-sample problem. For each k G 
{1,..., iF}, we consider a setting made of independent observations : i G {1,..., n^}} of a real-valued 
r.v. X^. The d.f. of X^ is denoted by F^ and is assumed to be continuous. We would like to test, Fq being a 
fixed continuous d.f., the null hypothesis 

no : F^ = F'^ = ■■■ = F^ = Fq. 

For any iT-tuple of positive integers n = (rei,..., uk), set |n| = Ylk=i I®*- 


be the pooled sample of total size |n|, be the integrated empirical d.f. based upon Zi ,..., for 

each k G {1,..., K}, be the integrated empirical d.f. based upon X ^,..., X^^. Of course, we have the 
following identity: 

Bi^,n = (3.1) 

k=l 


Next, we define the integrated K-sample empirical process in the following way: for any iT-tuple n = 


inu...,nK) G (N*)^, 


K 

■= ^nk (Fnfe(t) 


k=l 


for t G M. 


Obvious candidates for testing Hypothesis n^ are the integrated K-sample Kolmogorov-Smimov statistics and 
the integrated K-sample Cramer-von Mises functional (the usual square being included in the definition of n) 


SK,n-=Snp^K,n{t) and TK,n-= ^K,n{i)dFoit). 
teK Jm 


Set 


(j)f(n) := max ■ 
l<k<K 


I log log Uk 
nk 


log Uk >. 


The following result is a consequence of Corollary 2.4. 
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Theorem 3.6 On a suitable probability space, it is possible to define ^ ^ (N*)^}, jointly with a 

sequence of processes : n G (N*)^}, such that, under T-L^, with probability 1, as mini<fc<;^nfc oo. 


sup = 0{fiK{n)), 


where, for each n = (rei,..., tik) £ (N*)^, ^ is the process defined by 


Bkn(i) := mf 


K 


K 


2-1 


L \A:=1 


\k=l 


E“«(^«(*)) 1 - (Ei/S<(^o(‘)) 


for i G M, 


the processes : m G N*}, A: G {1,... , K}, consisting of K sequences of Brownian bridges constructed as 
in Theorem 2.2. 


The next result, which is an immediate consequence of the previous theorem (observe that 8^,^ and TK,n 
are bounded linear functionals of the process „), gives the limit null distributions of the statistics under 
consideration. 

Corollary 3.7 We have, under TL^, with probability l,for n = (ni,..., uk) such that mini<fc<j^ —)• oo, 


SK,n - supB|^^^(f) 
teK 


0 ((/>|f(n)) and 


TlK,n 


^K,nii)dFo{t) 


0{fKin))- 


4 The change-point problem 

Here and elsewhere, [t\ denotes the largest integer not exceeding t. In many practical applications, we as¬ 
sume the structural stability of statistical models and this fundamental assumption needs to be tested before 
it can be applied. This is called the analysis of structural breaks, or change-points, which has led to the de¬ 
velopment of a variety of theoretical and practical results. For good sources of references to research liter¬ 
ature in this area along with statistical applications, the reader may consult Brodsky and Darkhovsky (1993), 
Csdrgo and Horvath (1997) and Chen and Gupta (2000). For recent references on the subject we may refer, 
among many others, to Bouzebda (2012), Aue and Horvath (2013), Chan et al. (2013), Horvath and Rice (2014), 
Alvarez-Andrade and Bouzebda (2014) and Bouzebda (2014). 

In this section, we deal with testing changes in d.f.’s for a sequence of independent real-valued r.v.’s ..., Xn- 
The corresponding null hypothesis that we want to test is 

n'o : Xi,...,Xn haved.f. F. 

As frequently done, the behavior of the derived tests will be investigated under the alternative hypothesis of a 
single change-point 

TL'l :3 k* G {1,..., n — 1} such that Xi,..., X^* have d.f. F and ..., Xn have d.f. G. 

The d.f.’s F and G are assumed to be continuous. The critical integer k* can be written as [nsj for a certain 
s G [0,1). Then, testing the null hypothesis TLq can be based on functionals of the following process: set, for 
each n G N*, 

t) := (i) _ for s G [0,1], f G M, (4.1) 

where F^i. is the integrated empirical d.f. based upon the k first observations and is that based upon 

the (n — k) last ones. In (4.1) we extend the definition of F^ and F^ to the case where A = 0 by setting 
Fq = F^ = 0, so that 5n(S) f) = 0 if s G (0,1/n). 









We can define the r.v.’s Xi,..., and ..., X„ on a probability space on which we can simul¬ 

taneously construct two Kiefer processes {IKi(s, u) : s S M, u £ [0,1]} and { 1 ^ 2 ( 5 , tt) : s £ M, u G [0,1]} such 
that the “restricted” processes {]Ki(s,m) : s £ [l,n/2],u £ [0,1]} and {]K 2 (s,ri) : s £ [n/2,n],tt £ [0,1]} are 
independent. It turns out that a natural approximation of {5^ : £ N* } is given by the sequence of Gaussian 

processes {]K.„(s, X(t)) : s £ [0,1], t £ M, n £ N*} defined by 

-^[K 2 {[ns\,u) - s(Ki([n/2j,u) + ]K2([n/2j,u))] for s £ [O, i],?/ € [0,1] 

^[- IKi([n(l - s)J,«) -h (1 - s)(]Ki([n/2j,u) +K2{[n/2\,u))] for s £ [i, l],u £ [0,1]. 

More precisely, we have the following result. 

Theorem 4.1 On a suitable probability space, it is possible to define : n € N* }, jointly with a sequence of 
Gaussian processes : n € N*} as above, such that, under T-Lq, with probability 1, as n ^ 00 , 

sup sup |q!„(s, t) — ]K„(s, F(t))| = O 
se[0,l] iSK 

According to Csorgo et al. (1997), a way to test change-point is to use the following statistics: 




Tn := sup sup |an(s,t)| • (4.2) 

se[o,i] teR 

The corollary below is a consequence of Theorem 4.1 . 

CoroUary 4.2 IfH'^ holds true, then we have the convergence in distribution, as n ^ 00 , 

Tn sup |]K(S,U)|, 

s,ue[o,i] 


where K = {]K(s, u) : s,u £ [0,1]} is a Gaussian process with mean zero and covariance function 

E (]K.(s, tt)]K(s', u')) = uu {u Au — uu^){s As' — ss'). 


One has ]K(s, u) = uK(s, u) where K is a tied-down Kiefer process. We refer to Csorgo and Horvath (1997) 
for more details on the process K. 

Actually, according to Csorgo et al. (1997), the most appropriate way to test change-point is to use the 
following weighted statistic: 


an(s,t) 

Tn,w ■= sup sup T- -7—- 

5e[0,i] teR w{[ns\/n 


(4.3) 


where m is a positive function defined on (0,1), increasing in a neighborhood of zero and decreasing in a 
neighborhood of one, satisfying the condition 


I{w,e) 



sw‘^{s) \ ds 
s(l — s)) s(l — s) 


for some constant e > 0. For a history and further applications of I{w,e), we refer to Csorgo and Horvath 
(1993), Chapter 4. From Szyszkowicz (1992), an example of such function w is given by 

/ 1 y /2 

w{t) := \ t{l - t) log log for t£(0,1). 


By using similar techniques to those which are developed in Csorgo and Horvath (1997), one may show that, as 

n ^ 00 , 


'fn,w 



sup 

s,«e[o,i] 


w(s) 


For more details, we refer to Alvarez-Andrade and Bouzebda (2014). 
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Remark 4.3 As in Szyszkowicz (1994), we mention that the statistic given by (4.2) should be more powerful for 
detecting changes that occur in the middle, i.e., near n/2, where k/n(l — k/n) reaches its maximum, than for 
the ones occurring near the end points. The advantage of using the weighted statistic defined in (4.3) is the 
detection of changes that occur near the end points, while retaining the sensitivity to possible changes in the 
middle as well. 

We hope that the results presented in Sections 3 and 4 will be the prototypes of other various applications. 


5 Strong approximation of the integrated empirical process when parameters 
are estimated 

In this section, we are interested in the strong approximation of the integrated empirical process when parameters 
are estimated. Our approach is in the same spirit of Burke et al. (1979). Let us introduce, for each n € N*, the 
integrated estimated empirical process an’- 

an{t) ■.= s/n{¥n{t) - F[t,en)^ for t G M, (5.1) 

where : n G N*} is a sequence of estimators of a parameter 9 from a family of d.f.’s {F(t, 0) : f G M, 0 G 
0} (0 being a subset of and d a fixed positive integer) related to a sequence of i.i.d. r.v.’s {Xi : i G N*}. 
Let us mention that a general study of the weak convergence of the estimated empirical process was carried out 
by Durbin (1973). For a more recent reference, we may refer to Genz and Haeusler (2006) where the authors 
investigated the empirical processes with estimated parameters under auxiliary information and provided some 
results regarding the bootstrap in order to evaluate the limiting laws. 

Let us introduce some notations. 

(5.1) The transpose of a vector V of will be denoted by V~^. 

(5.2) The norm || • || on is defined by 

\\{yi,---,yd)\\ ■= maxJr/il. 

l<2<a 

(5.3) For a function (t, 6) i—>• g(t, 0) where 9 = (0i,..., Of) G VQg(t, 9f) denofes fhe vector in of 
partial derivatives {^(dg/d6i)(t, 9),... , (dg/d6d)(t, 0))) evaluated al 0 = 0o, and VQg(t, 0) denofes fhe 
d X d malrix of second order partial derivatives (y(d‘^g/d6id9j)(t,9))^.^^^ 

(5.4) For a vector V = (vi,... ,Vd) & f V denofes fhe vector (f vi,... ,f Vd)- 

Nexl, we write oul fhe sel of all condifions (fhose of Burke et al. (1979)) which will be used in fhe sequel. 

(i) The esfimafor 0„ admits the following form: for each n G N*, 

1 ” 

s/n (^9n — 00 ^ = l{Xi, 9q) + Sn, 

^ i=l 

where 9q is the theoretical true value of 0, ((•, 9q) is a measurable d-dimensional vector-valued function, 
and En converges to zero as n —)• oo in a manner to be specified laler on. Nolice fhal 

1 ” 

— 9o) = V^ l{s, 0o) dF„(s). 

V ^ , _1 J — oo 
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(ii) The mean value of l{Xi, 6 q) vanishes: 6q)) = 0. 

(hi) The matrix M{6q) := K(^l{Xi, 6Q)~^l{Xi, 6 q)) is a finite nonnegative definite d x d matrix. 

(iv) The vector-valued function (f, 6) i—;■ XeF{t, 6) is uniformly continuous in f S M and 0 S V, where V is 
the closure of a given neighborhood of Oq. 

(v) Each component of the vector-valued function t i—)• l{t,9Q) is of bounded variation in t on each finite 
interval of R. 

(vi) The vector-valued function 1 1 —)• X 0 F{t, 6 q) is uniformly bounded in f G R, and the vector-valued function 
(f, 0) I— XQF{t, 0) is uniformly bounded in f G R and 0 G V. 

(vii) Set 

^(s,0o) := ((F"^(s,0o),0o) for s G (0,1) 

where 

F~^{s, Oq) = inf{f G R : F{t, Oq) > s}. 

The limiting relations below hold: 

lim v^sloglog(l/s) ||£(s,0o)|| =0 and lim v^(l - s) loglog[l/(l - s)] ||£(s,0o)|| = 0, 

s \0 S /^1 


(viii) Set 


Oq) := —(s, Oq) for s G (0,1). 

The partial derivative Oq) exist for every s G (0,1) and the bounds below hold: there is a positive 
constant C such that 


s 11 / 5 ( 5 , 0o)II < C for all 5 G ( 0 , and (1 — s) 11 / 5 ( 5 , 0o)|| < C for all 5 G (^, l). 


Now, we state an analogous result to Theorem 3.1 of Burke etaZ. (1979). For each n G N*, let = 
{Gn{t) : Z G R} be the process defined by 


Gn{t) := 


1 


IC(n,F(Z,0o))- / Z(5,0o)dsIC(n,F(5,0o)) VeF(t,0o) 


\T 


^ (K(n,F(Z,0o)) - W(n)V 0 F(Z, 0 o)^ 


^/n 


for t G 


where we sef 

W(r) := [ l{s,Oo)dsK{T,F{s,OQ)) for r > 0. 

7k 

The process {W(t) : r > 0} is a cZ-dimensional Brownian motion with a covariance matrix of rank that of 
XI {Oq). The estimated empirical process given by an defined by (5.1) will be approximated by the sequence of 
processes Gn ■= {F{t, Oq) Gn{t) : t G R}. Set 

Bn ■■= sup |an(Z) “ Gn{t)\. 
teK 

Theorem 5.1 Suppose that the sequence of estimators {0^ : n G N*} satisfies Conditions (i), (ii) and (iii). 
Then, as n ^ 00 , 

_ P P 

(a) £n —)• 0 if Conditions (iv), (v) hold and — > 0; 
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(b) £n 0 if Conditions (vi)-(viii) hold and £n 0; 

(c) £n = 0{max{h{n),n~'')) for some e > 0 if Conditions (vi)-(viii) hold and = 0{h{n)) for some 
function h satisfying h(n) > 0 and h{n) —)• 0. 

The limiting Gaussian process Gn of Theorem 5.1 depends crucially on F and also on the true theoretical value 
6q. In general, Theorem 5.1 cannot be used to test the composite hypothesis : 

F e {F{t, 6) : t eM,0 € ©}. 


In order to circumvent this problem, Burke et al. (1979) proposed an approximate solution, they introduce an¬ 
other process: 

dn{t) := ^ (K{n,F{t,dn)) -^{n)VeF{t,dnyy 

Under some regularity conditions, Burke et al. (1979) show that (see Theorem 3.2 therein), as n —>• oo, 


sup 

teM 


Gn{t) — Gn{t) 


0 . 


Setting Gn{t) = F{t, On) Gn{t), one can show that, as n —oo. 


sup 

teM 


Gnit) - Gn{t) 


0 . 


(5.2) 


Consequently, we have, as n —)• oo. 


sup 

teK 


an{t) - Gn(t) 



0 . 


6 Local time of the integrated empirical process 


In this section, we are mainly concerned with the behavior of the local time of the integrated empirical pro¬ 
cess. This characterization is possible by making use of a representation provided by Henze and Nikitin (2002) 
that expresses the integrated empirical process in terms of a partial sums process, see (6.1) below. Recall the 
definition of the process given in (1.4). Set 



I3n{v) dv. 


In this part, we focus on the particular r.v. An = l^niX). According to Henze and Nikitin (2002) p. 185, we have 
the following representation for An'- 




i=l 


Sn 


s/n 


where {5^ : n G N*} is the following partial sums process where the summands are i.i.d. r.v.’s with mean zero 
and values in the interval I := [—1/2,1/2]: 


Sn:= 



(6.1) 


Notice that we are dealing with a sum of strongly non-lattice r.v.’s as, i.e., in p. 210 of Bass and Khoshnevisan 
(1993a). Indeed, we easily check that the characteristic function x of the (1/2 — (7i)’s, namely 


sin(z/2) 
z/2 ’ 
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satisfies the conditions 

Vz G M*, \x{z)\ < 1 and 

Next, we define the local time 


limsup |x(z)| < 1. 

\z\^oo 


n 

X(x, n) := ^ — x) for x G M, n G N*. 

i=l 


( 6 . 2 ) 


The local time A(x, n) represents the number of visits of the random walk {5^ : n G N*} in the neighborhood 
X + / of X up to discrete time n. Revesz (1981) proved that if the random walk is symmetric, then, on some 
enlarged probability space supporting also a Brownian motion with local time Z(x, t) defined as in (6.4) below, 
we have, for any e > 0, almost surely, as n —^ oo. 


sup |A(x, n) — /(x, n)| = 




Actually, Bass and Khoshnevisan (1993a) obtained the more precise estimate (see Theorem 4.5 therein) below. 


Theorem B We have, with probability 1, as n ^ oo, 

sup sup |A(x, [nt\) — l{x,nt)\ = ofn^(^(logn)^/^(loglogn)^/^y (6.3) 

xeKte[o,i] ^ 

In the present context, our aim is to obtain the rate of the approximation of the self-intersection local time 


Ln{t) 


E 


— x)l/(5j — x) dx 


by the integrated local time of some standard Wiener process. The quantity Ln{t) enumerates in a certain manner 
the couples (i, j) of distinct and ordered indices up to time [ntj such that Si — Sj is less than the diameter of I. 

To this aim, we recall that, if {W(t) : t > 0} is the standard Wiener process with W(0) = 0, then its local 
time process {Z(x, t) : t > 0, x G M} is defined as 


1 

l{x, t) := lim — / l/^_e<w(s)<x+e} ds for x G M, t > 0. 
efo ze Jq 


Let us introduce the corresponding normalized local time In- 

1 


ln{x,t) := ^=l{^/nx,[nt\) for x G M, t > 0, n G N*. 
Jn 


(6.4) 


Theorem 6.1 We have, with probability 1, as n ^ oo. 


sup 

te[o,i] 


Ln{t) - J ln{x,tfdx = o(^n®/'^(logn)^/^(loglogn)^/'^y 
Lemma 2.2 of Hu and Khoshnevisan (2010) stipulates, almost surely, as n —)• oo, 

f l{x,n)‘^ dx = 

Jk. 


Actually, when looking at the proof of this lemma, one can prove more precisely that, almost surely, there exist 
two positive constants k'i and ^2 such that, as n —>• oo, 

j^3/2 r _ 

- < / l{x,n)'^ dx < ^2 n^/^Y^loglogn. (6.5) 

Vlog log n 


we obtain the following result. 
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Corollary 6.2 We have, with probability 1, for any t G (0,1], there exist two positive constants ki and K 2 such 
that, almost surely, for large enough n. 


Ki < Ln{t) < K2 [nt\ logn. (6.6) 

Vlog log n 

In particular, for any t G (0,1], almost surely, as n ^ oo, 

Ln{t) = \ 

1 Mathematical developments 

This section is devoted to the detailed proofs of our results. The previously displayed notations continue to be 
used in the sequel. 


7.1 Proof of Formula (1.6) 


For the completeness of the paper, we provide here a proof of (1.6) inspired by Henze and Nikitin (2002). The 
function F„ can be computed as follows: for any n G N* and any f G M, 




1 . ^ , /"* 

^ j=l -'-oo 


Y^n{Xj)l{Xj<t} 

1=1 


1 




l<i j'<n 


Because of the hypothesis that the d.f. F is continuous, the sampled variables Xi,X 2 , ..., Xn are almost surely 
all different. Then, we can define with probability 1 the order statistics 


-’^(1) < -^(2) < • • • < 

associated with Xi, X 2 ,..., X„. Notice that the inequality X^jy < is equivalent to i < j, and that the event 
{X(j) < t} is equal to {nF„(t) < j}. Hence, we can write that, with probability 1, for any n G N* and any 
t G M, 


- f;2 Y -f^fY 

= e : 1 < i < j < iiF„(f)}- 

Now, we see that the foregoing cardinality is nothing but the number of combinations with repetitions of two 
integers lying between 1 and nF„(t), which coincides with the number of combinations without repetitions of 
two integers lying between 1 and nF„(f) + 1, namely 

^nF„(f) + 1^ 


This completes the proof of (1.6). 


□ 
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7.2 Proof of Theorem 2.2 


Making use of (1.6) together with the elementary identity — b'^ = 2b{a — 6) + (a — 6)^, we can write, a.s., for 
any t G M, n G N*, 

an{t) = \Vn - F{tf) + -;^j= ¥n{t) 

= V^F{t) (F,(f) - F{t)) + {¥n{t) - Fit)f + ^ F„(f) 

2 2y/n 

= F{t)an{t) + +-^^¥n{t). (7.1) 

2 ^/n 2yn 

Since 0 < F„(f) < 1, it is clear that, a.s., for any f G ffi, n G N*, 

F{t) an{t) + an{tf < an{t) < F{t) an{t) + an{tf + 

Zy/Tl Zy/Tl Zy^Tl 

Consequently, since 0 < F{t) < 1, we have (by roughly bounding 1/2 by 1), a.s., for any n G N*, 

sup \an{t) - F{t)Mn{F{t))\ < sup \an{t) - ]Bn(-F(f))| + ^supan(f)^ + 

teM teM isR 

from which we deduce 

Fjsup|a„(f) - F(t)B„(F(f))| > ^ (Alogn + x) j 
UeR ' y/n j 

< p|sup \anit) - ]Bn(F’(f))| + ^ supa„(f)^ > (^logn + x - 1) 1. 

IteR teR J 

Now, using the elementary inequality P{X + Y > a} < P{X > 6} + P{y > a — b} which is valid for any 
r.v.’s X, Y and any real numbers a, b, we obtain 


pjsup \an{t) - F(f)B„(F(f))| > (^logn + x) j 

UeR y/n J 

< pjsup|Q!„(f) -B„(F(f))| > (AlognY ^ - 1)1 + P jsup Q;n(f)^ > ^1- (7.2) 

UeR ' y/n 2 J (tgjR 2 J 

The inequality of Dvoretzky et al. (1956) stipulates that there exists a positive constant C 4 such that 


p| sup |F„(f) - F{t)\ > 1 < C 4 e 

UeR S n \ 

for all X > 0 and all n G N*. An application of (7.3) gives for any x > 1 and all re G N* 

pjsup Q;„(f)^ > ^1 < C 4 e"^. 

I teR 2 J 

Now, by putting (2.1) and (7.4) into (7.2), we complete the proof of Theorem 2.2. 


(7.3) 


(7.4) 

□ 
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7.3 Proof of Corollary 2.3 

The functional <1> being Lipschitz, there exists a positive constant L such that, for any functions u,v, |<h(tt) — 
< L supjgjg |ri(t) — v{t)\, inequality that we will use in the form 

^{v) — Lsup \u{t) — v{t)\ < <h(rt) < <h(r;) + Lsup \u{t) — v(t)\. (7.5) 

teR teK 


Let us choose for u, v the processes Un := an{-) and 14 := C(-) ]B„(F(-)). Applying the elementary inequality 
|P(A) — P(77)| < P(A\i7) + P(77\A) to the events A = {^{Un) < a;} and B = {<1>(14) < x} provides, for 
any x G M and any n G N*, 

|F{$(C„) < x} - P{$(K) < x}| < rmUn) < X < ^>(K)} + P{^>(K) < X < 

By (7.5), we see that 


n^{Un)<X<^Vn)}<F{^Vn)-Lsup\Un{t)-Vn{t)\<X<^Vn)}, 

teK 

P{$(K) < X < ^>(C/n)} < P<j ^>(K) < X < T>(K) + L sup \Unit) - K(f)| 

teR 


from which we deduce, by addition, that 


|P{^>(C„) < x} - P{^>(K) < x}| < P<^ |T>(K) - x| < Lsup \Unit) - Vn{t)\ 

teR 


(7.6) 


On the other hand, by choosing x = c log n for a suitable constant c in (2.2) that will be specified below and 
putting e„ := (A + c) \ogn/^/n, we obtain the estimate below valid for large enough n\ 


SUp|f7n(t) - 14(f) I > (-r 
t&R 


< 


n 


B 

Tc' 


By choosing c > 1/(2C), we have 


sup|L4(f) - 14(f) I > er, 

teK 



(7.7) 


Now, by (7.6), we write 


|P{$(C/J <x}-P{d>(K) <x}| =P sup |C/„(f)-K(f)| <e„,|^(K)-x| < Lsup |C/„(f)-K(f)| 

L teR teK 

+ pjsup \Un{t) - 14(f)| > en, |^(K) - x| < Lsup \Un{t) - 14(f)| 
L teK teK 


< P{|T>(14) - x| < Le„} + P<j sup |(/„(f) - 14(41 > 

. t&R 


(7.8) 


Noticing that the distribution of does not depend on n, which entails the equality P{|<h(14) — x| < Le^} = 
P{|d>(17) — x| < Len} where V := F{-)M{F{-)), and recalling the assumption that the r.v. d>(C) admits a 
density function bounded by M say, we get that, for any x G M and any n G N*, 


P{|^(14) - x\ < Le„} < 2LMen- 


(7.9) 


Finally, putting (7.7) and (7.9) into (7.8) leads to (2.3), which completes the proof of Corollary 2.3. □ 
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7.4 Proof of Corollary 2.4 

Applying (2.2) to a; = c' log n for some positive constant c' that will be specified below yields, for large 
enough n, 

TTn := pjsup \an{t) - F(t) B„(F(f)) | > C5 j < 

UeK vn } 

where we set C 5 = A + o' and cg = c'C. Now, we choose c' > l/C so that the series 7 r„) is convergent. 
Hence, by appealing to Borel-Cantelli lemma, we get that 


1 lim sup < 

sup 1 

V nSN* 

L teR 


.W))| >C5 


logn 


= 0 


which clearly implies Corollary 2.4. 


□ 


7.5 Proof of Theorem 2.5 

We write that, with probability 1, for any n G N*, 

Vkakit) - F{t)K{k,F{t)) 


max sup 

l<k<n jgK 


< max sup 

l<k<n tgK 

< max sup 

l<fc<n igR 


y/k F{t) atit) + 1 ai(f) + i Ffc(f) - F{t) K{k, F{t)) 
Vk ak{t) — K{k, F{t)) + max sup a|(f) + 1. 

l<k<n igR 


(7.10) 


In the last inequality above, we have used the facts that 0 < F{t) < 1 and 0 < F„(f) < 1 for alH G K and 
roughly bounded 1/2 by 1. Now, by Komlos et al. (1975), we have, almost surely, as n —)■ 00 , 


max sup 

l<k<n tgK 


y/kakit)-K{k,F{t)) =0((logn)^). 


(7.11) 


On the other hand, by using Chung (1949)’s law of the iterated logarithm for the empirical process which 
stipulates that 


lim sup 

n^oQ 


SUPfgRl«n(f)| 
Vlog log n 


1 

— a.s., 

y/2 


we see that, almost surely, as re —)• 00 , 


sup I an 
teR 


{t)\ = o(yiogio^y 


(7.12) 


By putting (7.11) and (7.12) into (7.10), we completes the proof of Theorem 2.5. 


□ 


7.6 Proof of Corollary 2.7 

We work under Hypothesis T-Lq. Let us introduce the integrated empirical process related to the d.f. Fq: 

ao,n(f) := y/n (F„(f) - Fo{t)) for t G M, re G N*. 

By the triangular inequality, we plainly have 

Sn - sup I Co (t) Bn (Co (t)) I < sup |ao,n(f) “ Co (t) Bn (Cq (f)) | 
teR iSR 
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from which together with (2.4) we deduce (2.7). Similarly, 


Tn- / [Fo{t)Mr,{Fo{t))Y dFoit) 


< [ ao,n{t? - [Fo{t)Mn{Fo{t))Y dFo{t) 

Jr 

< sup |ao,n(f) - i^o(i)Bn(-Fo(f))| 


teK 


X ( sup|ao,n(f)| + sup |Fo(f)B„(Fo(f))| 
\teR reR 


(7.13) 


In the last inequality above appears the supremum 


sup|Fo(f)]Bn(Fo(f))| < sup |]Bn(w)|- 
teR Me[o,i] 

On the other hand, by Komlos et al. (1975), on a suitable probability space, we can define the empirical pro¬ 
cess {fin '■ n G N*}, in combination with the sequence of Brownian bridges {B^ : n G N*}, such that, with 
probability 1, as n —)• oo, 

sup l/3„(n) - B„(n)| = (7.14) 

«e[o,i] V / 

Actually, this is a consequence of (2.1). In view of (7.12) and (7.14), one derives the following bound: with 
probability 1, as n —)• oo, 

sup |B„(u)| = O (y/log log n ) . (7.15) 

ue[o,i] ^ ' 

Finally, by putting (2.4), (2.6) and (7.15) into (7.13), we immediately deduce (2.8). The proof of Corollary 2.7 
is finished. □ 


7.7 Proof of Corollary 3.3 

For each m,n G N*, lef and denofe fhe empirical processes respecfively associated with the samples 
Xi,...,XmandYi,...,Yn. Byreplacing IFm(f) by a^(t)/y/m +F(t) and Gn(t) by a^(t)/^/n + G(t), using 
the binomial theorem and recalling that, under 'Hq, F = G, we write 


7(9) _ I 

Sm,n v^/ 


m n 


mn 
m + n 


m 


k=l 


XiDntr' 


“m(*) 


n 

k 




= qF{t) 


q-l 


m + n 


OimijJ) 


where we set 




mn 
m + n 


k=2 




\q-k 


mX n 


«m (0 


ai{t) + Am,n{t) 




By (2.6) and the fact that 0 < F{t) < 1 for any f G M, it is easily seen that, with probability 1, as m, re — 00 , 

IA {loglogmy/^\ {{loglogny/^\ 

sup Am,n(f) = o - -= - +0 - 1= - • (7-16) 

isR \ \A« / V ^ / 

On the other hand, by Corollary 2.4, we can construct two sequences of Brownian bridges {B^ : m G N* } and 
{B^ : re G N*} such that, with probability 1, as m, re ^ 00 , 


teR 


(log m \ 

. 

V 

sup 1 

teR 


log re 


(7.17) 
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»*(?) 


Setting Mrn% as in Corollary 3.3, we have 


n 


m 


m + n 


{(xl{t)-F{t)Ml{F{t))) 
3“ 


m + n 

By putting (7.16) and (7.17) into (7.18), we deduce the result announced in Corollary 3.3. 

7.8 Proof of Theorem 3.6 

Let us introduce, for each k £ {1,... , K}, the integrated empirical process associated with the d.f. 

-/c / . -^k 


(7.18) 

□ 


a^{t) := ^ - F {t)j for f € M, n £ N*. 

By recalling (3.1) and making use of the most well-known variance formula 

K K 


nk{xk = '^ rikixk - xof - |n| (x - xqY 


k=l 


k=l 


where we have denoted |n| = 'Y2ik=i ® ~ Sfc=i "^kXk for ri = (ni,..., nx), we rewrite 


1 


under Hypothesis T-Lq as 


iK,r.{t) = J2^k (f", it) - Fo{t)) - — K] nfc (t) - Fc 

k=l Vfc=l 


k=l \k=l 

Next, setting ^ in Theorem 3.6, we have 

where we put, for any f G M and any n = (ni,..., nx) G N*, 

K 


(7.19) 


Ai,n(f) = <(f)2 -Fo(t)2]B^jFo(f))" , 


K 


k=l 


A2.„(t)= (E\/S<(*)) -1 


K 


'^k 


^fc=l 


k=l 


By setting, for any fe G {1,... , F}, any f G M and any n = (ni, ..., nx) £ N*, 

hAt)=^n,{t)-F,{t)Ml(,Fo{t)) and 6fc,„(f) = < (f) + Fo(f) ]B^^(Fo(f)) 
and writing Ai^n{t) and A 2 ,n{t) as 


K 


K 


k=l 


k=l 


Al,n(f) = V Sk,n{t) ek,n{t) and A2,n{t) = J ek,nit) 

L -i/ ^-i/ \/ 1^ ^^ \/ ITJI 


K 


k=l 


nk 

Ini 
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we derive the following inequalities: 


SUp|Al,r^(^)| < 
teM 


K / 

^ I SUp|4,ri(f)| 


( SUp|efc,n(f)| I, 
V J 


sup |A2,n(f)| < 

teR 


^ K 

E 

\k=l 


sup 14, 
teR 



By (2.4), (2.6) and (7.15), we get the bounds, a.s., for each fc £ {1,..., K}, as Uk —)• oo, 

sup \Sk,n{t)\ = O ( 
iSR V 

Finally, by putting (7.21) into (7.20), and next into (7.19), we finish the proof of Theorem 3.6. 


and 


sup |efc,.„,(t)| = o(y/log log Uk 
teR ^ 


(7.20) 


(7.21) 

□ 


7.9 Proof of Theorem 4.1 

In the computations below, the superscript ” in the quantities F, F, U and a refers to the first k observations 
while the superscript “+” refers to the last n — k observations. By (1.6), we have the following representation 
for din{s, t): with probability 1, for n € N*, f £ M and s £ (0,1), 




[nsj (n — [nsj) 

n3l2 

[nsj (n — [nsj) 
2n3/2 


(•'[n.jW-ni)) 


[nsJ (n — [nsJ) 



Pr I (A- 

[nsj '' 2 


- - m] 

) - {K-lnsiit)" - ntf) 

n- [nsj 


By using again the elementary identity a? — = 2b{a — b) + {a — 6)^, we can write an{s, t), a.s., for n £ N*, 

t £ M and s £ (0,1), in the form 


a„(s, t) = 4(s, t) - I4(s, t) + II4(s, t) + IV„(s, t) 


(7.22) 


where 


In (s,f) 

IIn(s,f) 

ni„(s,f) 


IVn(s,f) 


I ns I (n — I res I ) „, , 

^,3/2^ ' nt) 

[resj(re- [resj) 

„3/2 

[resj (re — [resj) 


\/\ns\ (re — [resj) 


re 


3/2 


(A, 


[res] y/re - [res] , 

j^3/2 I I ®n—[nsj ( I’ 


2re3/2 


F 


[nsj 


(f)-F(f)) -(F+_L^^j(f)-F(f)) 


((re - LresJ)«L^^j(f)2 - LnsJa+_L^^j(f)2) 
((re - [resj)F-^j(f) - [resjF+_^^^j(f)). 


By (7.12) and by using the fact that F„ is bounded, we get that, with probability 1, as re —)• oo, uniformly in s 
and t, 


TTT .N ^l^loglogre 

V 


and IV„(s,f) = 0 ^ 
fn 
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which, inserted in {1 21), provides, with probability 1, as n —)• oo, uniformly in s and t, 


an{s,t) = ln{s,t) 


IIn(s, t) -\- O 


log log n ^ 

^7^)' 


(7.23) 


Let us introduce, for n G N* and s, u G (0,1), 


I^(s,m) = 


[nsj (n — [nsj) 




n — [nsj 


[nsJ 


- u) 


2 = 1 




re' 


3/2 


n— [nsJ 


re - re = 


[resj 


n 


3/2 


{^{Ui<u} '<7 j) 

V 2=[t25J+1 / 


and 

Sn{s,u) = ln{s,u) -I4(s,re). 

Then, we have the following equalities 


F{t)) = I,(s, t), I4(s, F{t)) = II„(s, t), 


and {121) becomes, with probability 1, as re —)• oo, uniformly in s and t. 


an{s,t) = 6n{s,F{t)) + O 


log log re \ 


Now, observe that 


/ L^sJ I I n 

^nis, u) = ^IY1 ^ Y1 

' \ i=l i=l 


re /re — [resJ 
re 


re 


*=1 i=[nsj+l / 


We know from Komlos et al. (1975) and Csorgo and Horvath (1997) that, almost surely, as re —)• oo. 


[nsJ 

sup sup ^ (1 ({/, <„} - re) - K 2 ( [resJ , re) 
se[o,i/ 2 ]«e[o,i] 


0((logre)^), 


sup sup V - re) - ]Ki([resJ,re) 

se[i/ 2 ,i]tie[o,i] 


0((logre)^). 


Notice that we have the following decomposition 

n L'^/2j n 

X] (l{C/i<«} - ''^) = X] (l{C/i<«} - ^) + X] {}-{Ui<u}-u). 

i=l 2=1 2=[r2/2j+l 

Hence, by adding {1 21) and (7.28), we readily infer that, almost surely, as re —)• 00 , 


sup yy (i{{/i<«} - u) 
“6[0,1] 


(]Ki(Lre/2j,re)+IC2(Lre/2j,re)) 


0((logre)^). 


(7.24) 


(7.25) 

(7.26) 


(7.27) 

(7.28) 


(7.29) 
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As a byproduct, from (7.25)-(7.29) and recalling the definition of ]K„ given just before Theorem 4.1 , we deduce 
that, almost surely, as n —)• oo. 



(7.30) 


We finally conclude from (7.24) and (7.30) by using fhe triangle inequality: almost surely, as n —)• oo. 


sup sup|a„(s,f)-]K„(s,F(t))| < sup sup |a„(s, f) - (5„(s, F(t))| + sup sup |(5„(s, u) - ]K„(s, u)| 
se[o,i] isM se[o,i] teR se[o,i] Me[o,i] 


O 


( (logn)2 

V 


+ 0 


log log n \ 


O 


( (logn)2 

V 


This completes the proof of Theorem 4.1 . 


□ 


7.10 Proof of Corollary 4.2 

Straightforward algebra yields, for any s, t,u,v G [0,1], 

E^]K„(s, u) Kn{t, v)'j = — (u Av — uv) t) 

with 

[n(s A f)J — s[nt\ — f[nsj + 2[re/2jsf for s,t G [0,1/2], 


il)n{s,t) = < 


[n(l — s V f)J — (1 — s) [n(l — f)j 
-(1 - f)Ln(l - s)J + 2[n/2j(l - s)(l - t) for s,f G [1/2,1], 


s[n(l — f)J + (1 — f)[nsj — 2[n/2js(l — t) for s G [0,1/2], t G [1/2,1], 

^ (1 — s) [ntj + f[n(l — s)J — 2[n/2j (1 — s)t for s G [1/2,1], f G [0,1/2]. 

We immediately see that 


lim — 'ipn{s, t) = s At — st 

n^oo Tl 


and then 


lim E^]K„(f, u)lK„(s, u)^ = (s At — st) {u Av — uv) = E^K(f, u)lK(s, u)'j 


where K is the tied-down Kiefer process on [0,1] x [0,1]. This proves the convergence of Gaussian processes in 
distribution, as n —oo, 

which in turn, together with Theorem 4.1, entails Corollary 4.2. 

7.11 Proof of Theorem 5.1 

Let us write an{t) as follows: with probability 1, for any f G M, re G N*, 


a. 


{t) = V^(¥n{t)-F{t,dn)) = Y {¥n{t)^ - F{t,dY) + ^^t) 


= V^F{t,dn) (iFn(f) - F{tX)) + ^ {^n{t) - ^ F^f) 


= F{t, On) an{t) + 7^ S„(t)^ + 7^ F„(t). 

^Y Tl ZyJ71 
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Straightforward algebra yields, a.s., for any f E M, n E N*, 




(^F{tX) + ^ Gnit)^ {an{t) - Gn{t)) + ^ (a„(t) - Gn{t)f 

+ ^n) “ Gn{t) + 2^^ Gn{t)‘^ + 


Recall the definition of given just before Theorem 5.1 and set 


(7.31) 


77„ := sup \an{t) - Gn(f)|. 
teK 


Using again the inequalities 0 < F{t) < 1 and 0 < F„(t) < 1 and roughly bounding 1/2 by 1, we extract from 
(7.31) that, a.s., for any f S M, n £ N*, 


£n ^ 1 1 + 


1 


sup|G„(f)| 

n tgK 


Vn + 


n 


vl + 


1 + sup G„(f)' 
t&s. 


+ sup 
teR 


F{t,dn) - F{t,eo] 


sup|G„(f)|. 

teR 


(7.32) 


We know from Theorem 3.1 of Burke et al. (1979) that satisfies the same limiting results that those displayed 
in Theorem 5.1 for Next, we need to derive some bounds for sup^g^ \Gn{t)\ and sup^gj^ \F(t,9n) — 
F{t, 0o)| as n —>• oo. First, by (7.11), we have, almost surely, as n —oo. 


sup 

teR 


Unit) 


n 


K{n,F{t)) 


( (logn)2 

V 


from which we deduce, due to (7.12), almost surely, as n —)■ oo. 



Notice that the same bound holds for the Brownian motion {W(n) : n € N*} introduce before Theorem 5.1. 
Hence, by Condition (iv) and the definition of Gn{t), with probability 1, as n ^ oo. 


sup|Gn(f)| =0(vnloglogn 
teR ^ 


(7.33) 


On the other hand, using the one-term Taylor expansion of F{-,0) with respect to Oq, there exists 0* lying in 
the segment [0Oj^n] such that 

F{t, On) - F{t, 0o) = (On - 0o) ^eF{t, 0*^. (7.34) 

In case (a) of Theorem 5.1, ^/n {6^ — Oq) is asymptotically normal and then — 0o) tends to zero as 

n —oo in probability. Therefore, by (7.33) and (7.34), sup^gj^ \ F(t, On) — F{t, 0o)| supjgjg \ Gn{t)\ also tends 
to zero as re —)• oo in probability. Putting this into (7.32), we easily complete the proof of Theorem 5.1 in this 
case. In cases (b) and (c) of Theorem 5.1, referring to Burke et al. (1979) p. 779, we have the following bound 
for On — Oq: almost surely, as re —)• oo. 


By putting this into (7.34) and next in (1.32) with the aid of (7.33), we complete the proof of Theorem 5.1 in 
these two cases. 
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Finally, concerning Gn{t), we have 


Gn{t) - Gn{t) = F{t, 0„) (dnit) - G„(i)) + (^(i, - F(t, 0o)) Gn{t), 


from which we deduce 


sup 

teM 


Gnit) - Gn{t) < sup Gnit) 
teR 




I U 

teK 


teK 


Using the same bounds than previously, we immediately derive (5.2). 


□ 


7.12 Proof of Theorem 6.1 


In a similar way as in Bass and Khoshnevisan (1993a) (refer also to Bass and Khoshnevisan (1993b)), we con¬ 
sider the following normalized local time 


1 


An{x,t) X[^/nx,[nt\) for x G M, f G [0,1], n G N*, 


(7.35) 


where the local time A is defined by (6.2). We first decompose A„(x, f)^ into the sum of two components, by 
writing 


^ \nt\ \nt\ 

Anix,tf = - ^/nx) li{Sj -y/nx) 

^ i=lj=l 
[nt\ 


This, in turn, implies that 


h^ 2 _^ 

— ^ —-vAix) H— ^ li[Si — ^/nx) li[Sj — ^/nx). 

i=l 


\nt\ 


f An{x,t)‘^ dx = — I li[Si — ^/nx) dx -\— f Ij^Si — \Fix) li[Sj — ^/nx) dx. 

from which, by observing that l/(S'j — y/nx) dx = ^l\fn and that 

/ \i{Si-^x)\i{Sj - ^x) dx = 


(7.36) 


we readily infer that 

Ln{t) = \n^G f An{x,tf dx - 

^ Jr ^ 

In order to evaluate the right hand-side of (7.36), first, remark that 

/ An{x,tfdx- / ln{x,tf dx < sup |A„(x, t) -/„(x, f) | / {An{x,t)+ ln{x,t))dx. (7.37) 

Jr Jr xsk Jr 

By combining (7.35) with (6.3), we obtain, with probability 1, as n —)■ oo, 

sup sup |A„(x,f) -/„(x,f)l = o(n“^/^(logn)^/^(loglogn)^/^). (7.38) 

xeMteio,!] ^ ^ 
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Moreover, using the following relations satisfied by the normalized local times: 

/ An{x,t)dx= / ln{x,t) dx = [nt\/n, 

M 

we get, for any t £ [0,1] and any n G N*, 

/ {An{x, t) + ln{x, t)) dx < 2. 

Jm. 

Then, putting (7.38) and (7.39) into (J31) yields, with probability 1, as n —)• oo. 


sup 

te[o,i] 


/ An{x,t)‘^ dx — / ln{x,t)'^ dx 

7r 7k 


= o(n (log(loglogn 


Finally, from (7.36) and (7.40), we infer, with probability 1, as n —>• oo, uniformly in t, 
Ln{t) = ^n(a:,f)^ da: + (log (log log 

This completes the proof of Theorem 6.1 . 


(7.39) 


(7.40) 


□ 


7.13 Proof of Corollary 6.2 

We imitate the proof of Lemma 2.2 of Hu and Khoshnevisan (2010) yielding J^l{x, n)"^ dx = n^/2+°(i). For 
this, let us observe that 

/ l{x,n)‘^ dx = / l{x,n)‘^ dx 

t/M. J Iji 

where In is the range of the Brownian motion over the time interval [0, n], i.e.. 


In = 


inf W(s), sup W(s) 

se[0,n] se[0,n] 


and let us introduce the corresponding oscillation 

:= sup W(s) — inf W(s). 

se[0,n] se[o,n] 

By using Cauchy-Schwarz inequality, we write the inequalities 

2 


^ ( / l{x,n)dx ) < 


l{x,n)Ux< [ l{x,n)dxx sup l{x,n) 
Jr xsk 


which can be rewritten, since f^l{x, n) dx = n, as 

,2 f 


n 


< / l{x,n)"‘dx < n sup l{x,n). 


(7.41) 




Now, by invoking Paul Levy’s (Csdrgo and Revesz (1981) p. 36) and Kesten (1965)’s laws of the iterated loga¬ 
rithm which respectively state that 


|W(,)| ^ ^ and limsup = V2 a.s., 


lim sup - - - 

T^oo V7" log log T 


1{x,t) 

^sup^==== 
r^.oo Vt log log T 


we obtain that, with probability 1, there exist two positive constants k'^ and such that, for large enough n, 

< —-sjn log log n and sup ((x, re) < K 2 \/n log log re. (7.42) 

By putting (7.42) into (7.41), we deduce (6.5). Finally, by observing that ln{x, t)^ dx = re“^/^ dx 

and appealing to Theorem 6.1, we get (6.6). The proof of Corollary 6.2 is completed. 
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